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This booklet contains the printed material for use with Audio-tape 3 for the 
audio-tape sections of Networks 3 and Audio-tape 4 for the audio-tape 
sections of Graphs 4. 


You will need to play the tape at the same time as you study the frames on 
the following pages. 


Place the cassette player within easy reach. There are points on the tape 
where we have indicated that we want you to stop the tape and do some 
work for yourself, but you will probably find it necessary to stop the tape 
more often than this. Indeed, you should get into the habit of frequently 
stopping the tape and giving yourself time to think. 


Make sure that you have paper and pencil handy before starting each tape 
sequence. 


BLOCK 3 


Notes for Networks 3 


There are three sequences on the tape for this unit. The heading numbers 
below refer to the corresponding sections in Networks 3, 


In each tape sequence we demonstrate the use of an algorithm to solve an 
example. In the first two tape sequences we then ask you to use the 
algorithm to solve a problem. There is a problem on the third algorithm in 
the text of the unit. Additional problems requiring the use of these three 
algorithms are given in the Computer Activities Booklet. 


Each algorithm involves finding matchings in bipartite graphs, and is based 
on the idea of an alternating path, introduced in Section 2. As a reminder, 
this definition is given below. 


Definition 


Let G be a bipartite graph in which the set of vertices is divided into two 
disjoint subsets X and Y. An alternating path with respect to a matching 
M in G isa path which satisfies the conditions: 


(a) the path joins a vertex x in X toa vertex y in Y; 
(b) the initial and final vertices x and y are not incident with an edge 
in M; 


(c) alternate edges of the path are in M, and the other edges are not 
inM. 


2.2. Maximum matching algorithm 
3.1 Hungarian algorithm for the assignment problem 
4.1 Hungarian algorithm for the transportation problem 


A formal statement of each algorithm is given in the unit. You should have 
the unit open at the appropriate page whilst listening to each tape 
sequence. 


Page 14 has been left blank to enable other frames to face each other. 
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BLOCK 4 


Notes for Graphs 4 


There are two sequences on the tape, both associated with Section 5, The 
numbers 5.3 and 5.4 below refer to the corresponding sections in Graphs 4. 


In each sequence we describe an algorithm for solving a particular problem 
using a branch and bound method. The problems are: 


5.3 the knapsack problem; 
5.4 the travelling salesman problem. 


Each algorithm involves a search for an optimum solution based on the 
following ideas: 


* — abranching tree for structuring the search; 


* successive improvement of a lower bound for a number to be 
determined. 


In the case of the knapsack problem, the number to be determined is the 
total value of items packed. 


In the case of the travelling salesman problem, the number to be determined 
is the fotal length of the route. 


TRACKS 


The maximum matching algorithm 


1 WORKED PROBLEM 
Find a maximum matching in the following bipartite graph. 


v 


Ye USE 


Ys ¢ labelling procedure 
* matching improvement procedure 


2 SOLUTION TO WORKED PROBLEM 


PART A: LABEL VERTICES. 


STer1 STEF 2 Ster3 STEP 2 
label xs label ys label xs label ys 


x WM (xs) (wm NW (x) 


Xe Ye (x) (ye) xe Ye (xs) 


~ ree 
(*) x Ys () x ¥ (Ke) / breakehrough ) 
aby 4 
xq Ya (Xs) (ya) Ya (Xs) ig pene 

a ly, 


initial matching M could label 
Ys, with x, 


PART B: IMPROVE MATCHING 
STEP 4: FIND ALTERNATING PATH 


W) * MY (xe) 
(ya) x2 Ye (xs) 


(#) x5 Ys (X2) <— an alternating path is ( alternatively: 
; Yoxeyers YaXaYaxe 


(Ya) Xa Ya (xs) 


2 SOLUTION CONTINUED 
STEP 5: CONSTRUCT REVISED MATCHING 


v 


Ye 


ee ~~. 


alternatively: 
X1Yo Ya» Yar Xe Vs 


4, 


original matching revised matching 
Yb Yas V4 XY M4 Yar MeV Ms Yo 


Since the revised matching has 4 edges, it is a maximum matching. 


3 SUMMARY OF THE ALGORITHM 

START with any matching. 

Part A: labelling procedure Pmad Ny a 
Label the vertices to identify an alternating path. § ’"#kthrough occurs when a “> 
If breakthrough is achieved, go to Part B. (vertex in Y not incident with ) 


If breakthrough is not achieved, STOP: X ‘ gi face ot cere vd 
the current matching is a maximum matching. a eae : 


—— aoa es 


Part B: matching improvement procedure 
Find an alternating path by tracing back through the labels. 


Form a new matching from: 
* the edges in the current matching NOTIN the alternating ag 
* the edges in the alternating path NOT IN the current matchi g- 


Return to Part A. 


Find an improved matching in 
the following bipartite graph. 


TRACK I4 


5 SOLUTION 
PART A: LABEL VERTICES = _ 


STEP 1 Ster2 Ster3 
label xs label ys label xs 


(«) x (#) x 


% (*) w 
Ke 
Ye rep 
(ys) xe 


Ys (Ke) 
(#) x 


PART B: IMPROVE MATCHING 
STEP 4: FIND ALTERNATING PATH 


(*) ™ 
Nn (*) >. 


x, 2 ot ~ 
si Ye (x2) «— an alternating path is  _ alternatively: } 


(ys) x5 Yara yin “  -YeMsyaX%s 


Ya (a) A 


(x) x 


STEP 5: CONSTRUCT REVISED MATCHING 


ys 
Xa Xe 
initial matching revised matching of 


Xen XY XS YBe XY Xoo / alternatively: 
22Yb Xe Yar Xa V9) 


—— 


a 


Since the revised matching has 3 edges and there are 
only 3 vertices in Y, it is a maximum matching. 
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The Hungarian algorithm for the assignment problem 


A oe 
USE 
labelling procedure 
* matching improvement procedure 
modification of partial graph lade 


1 WORKED PROBLEM AK Sh 
Find the optimum assignment in the following case. 
jobs 
applicants — jobs 
x Nn 


2 SOLUTION TO WORKED PROBLEM 


STEP O: CONSTRUCT INITIAL PARTIAL GRAPH 
weights 


Ye A maximum 
( matching 
. % obtained 


yy inepection )) 
xy Ya. ——— 
first partial graph 


TRACK 1% 


2 SOLUTION CONTINUED 
PART A: LABEL VERTICES 


STEPS 1,5 STeP2 


6 x (=) % ons (mi) 

4 x> sap (yi) x2 Ya 
xB vs 

6 x Xe Ya 

first revised cost matrix labelled partial graph 


PART C: MODIFY PARTIAL GRAPH 


STEP 6: FIND 8 
unlabelled ys 
unlabelled ys 


v2 Ys Ya 


74" kk 
Mesetioe 5} 
} 


Ss ra 


5 xs 


first revised cost matrix 


STEP 7: REVISE COST MATRIX AND PARTIAL GRAPH 


second revised cost matrix second partial graph 


TRack1h 


2 SOLUTION CONTINUED 
PART A: LABEL VERTICES 


STEP 1 STEP 2 STEP 3 STer2 
(*) ™ NM (i) Ge) x 


Xo Ya ee (y) x2 
Xe 


x MS 


x4 V4 X4 
second partial graph labelled partial graph 


PART B: IMPROVE MATCHING 
STEP 4: an alternating path is y. xx). 


STEP 5: revised matching is: 


hew matching 
XB Yor M4 YBs MY X2 Ya 


10. x 
& x 
5 xs 


6% 
original cost matrix final revised cost matrix 


optimum assignment: xy, Ys. X3Yo X4 Ya 
total cost:6 + 1145+ 6=26=10+84+5+6-4404043 


TRACK 19 


3 SUMMARY OF THE ALGORITHM 


START with no matching. = 
Assign weights to the vertices and construct the first partial graph. 
Part A: labelling procedure 


Label the vertices to identify an alternating path. 
If none of the vertices on one side of the graph can be labelled, STOP: 
the current assignment is an optimum assignment. i 


— th en 
_- ~~ SHORT CUT 
If breakthrough is achieved, go to Part B. (first time only — find 


Fa 


If breakthrough is not achieved, go to Part C. |. matching by inspection 


Part B: matching improvement procedure 1 
Find an alternating path by tracing back through the labels. 

Form a new matching. 

Return to Part A. 


Part C: modification of the partial graph procedure 
Construct a revised cost matrix as follows. 


On the existing cost matrix: 

draw a horizontal line through each labelled vertex in X; 

draw a vertical line through each labelled vertex in Y; 

* find the smallest entry 5 with ONLY a horizontal line through it; 

* decrease all entries with ONLY a horizontal line through them by 5; 


increase the weight on the corresponding vertices in X by 5; 
* increase all entries with ONLY a vertical line through them by 6; 
decrease the weight on the corresponding vertices in Y by 6. 


Construct a revised paren graph. 


(Remove any edge t 
Return to Part A, 


t now has a non-zero cost.) 


Find the optimum assignment 
in the following case. 


10 


TRACK 21 


5 SOLUTION 
STEP O: CONSTRUCT INITIAL FARTIAL GRAPH 


uF 


TRACK 22 


5 SOLUTION CONTINUED 
PART A: LABEL VERTICES 


STEPS 1,3 StER2 
(ye) » v 


Xe Ye (xs) 
(#) x 
Xe Ya 
labelled partial graph 


PART C: MODIFY PARTIAL GRAPH 
STEP G6: FIND 8 


unlabelled yo 


(aay) 
Mi ye oe 


B x4 G 
first revised cost matrix 


STEP 7: REVISE COST MATRIX AND PARTIAL GRAPH 
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5 SOLUTION CONTINUED 
PART A: LABEL VERTICES 


STer 1 STer 2 
x Mi (xs) 


Xe Ye 
(+) x Ys 


xe ys 


labelled partial graph 


PART B: IMPROVE MATCHING 
STEP 4: an alternating path is yixs 


STEP 5: revised matching is: 


new matching 
MY 2 2 » X4 Var Yj 


FART A: LABEL VERTICES ( impossible) STOP 


1 


original cost matrix final revised cost 


ix 


oO 
4 
x tS 
mati 
‘ 


optimum assignment: xiyo, xo ¥s.X3Y. Xa a 
total cost:4+8+9+8=29=54+84+7+64+2-140+0 


es. oe —— ip 
@ 2 7 


USE 
* labelling procedure 
* flow-augmenting procedure 
_* modification of partial graph procedure 
1 WORKED PROBLEM as re i 


Find a minimum-cost solution to the transportation problem for the following situation. 


Ae aaa 
OA, Ke 


@a n® 
bipartite graph 


2 SOLUTION TO WORKED PROBLEM 
STEP O: CONSTRUCT INITIAL PARTIAL GRAPH 


first partial graph 


15 
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2 SOLUTION CONTINUED 
FART A: LABEL VERTICES 
STEPS 1-3 


First iteration 


i b, @)(A) 
MEA ——— 


b, 6) 
Oma 


breakthrough at > 


Second Iteration 


apyeeeeh (A) 
(*) @) i aaa 


LO) E> 
ome Ors 


breakthrough at b2 


Third Iteration 


b, (A) 
(*) @ A, ——— 


nO) i> 
OM Oa 


breakthrough at ba 


Fourth iteration 
ae By @ (A) 

b. (0) 

bs (2) 


PART B: AUGMENT FLOW 


~ STEPS.4,5 


pare te. 
@) ie 


eumne 


* flow-augmenting path is a 
© min (6, 4) = 4 
* send flow of 4 down A.) 


@a 


b, (0) 
@a — 
bo (6) 
. Rew auamantiia path is Agbz 


* min (9,6) =6 
© gend flow of G down Asbo 


an ® 


owas 


* flow- ener path is Aobs 
© min (3, 5) = 
© send flow of : down Azb= 


: are 


( breakthrough | 


TRACK 26 


2 SOLUTION CONTINUED 
PART C: MODIFY PARTIAL GRAPH 
STEP 6: FIND 


a a a 
/ unlabelled 
\ demands 


Pap 2 


eels 


A 
first revised cost matrix 


ie 
rie unlabelled 
Weald 
say bs 


ce 


STEP 7: REVISE COST MATRIX AND PARTIAL GRAPH 


410 
®@O® 
by bbe 

4@A 

3 OA 


second revised cost matrix 


ata 


PART A: LABEL VERTICES 


4 ob (0) (Ay) 
W@A 


LO”) E> 
(b) (©) Az 


be (2) (As) 
breakthrough at bs 


maximum 
flow along Agbz2is 6 


final flowis 4 along A\b, with cost 
2 along Ab» 
4 along Asbs 
5 along Aabs 


(4x 3) 
+ (2x5) 
+ (4x4) 
+ (5X3) =53 


b ©) 


os 
Aa 3 n® 


second partial graph 


PART B: AUGMENT FLOW 
10) 
2 
4 be © 
ba (0) 
° beagle path is bs Aobo A, 
© min (6, 2, 2) = 


° increase flow ty 20n Abo, Asbs 
* decrease flow by 2 on Apb2 


7 
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3 SUMMARY OF THE ALGORITHM 


START with no flow. 

Construct the initial partial graph. 

Part A: labelling procedure 

Label the vertices to identify a flow-augmenting path. 

If no labelling is possible, STOP: : _ Se 
the current solution is a minimum-cost solution. 7 breakthroughoccure when a) 


If breakthrough is achieved, go to Part B. \\ demand vertex is labelled whose 
If breakthrough is not achieved, go to Part C. ta demand is not satlefied . 


e a 


Part B: flow-augmenting procedure alias 


Find a flow-augmenting path by tracing back through the labels. 
Augment the flow. 
Return to Part A. 


Part C: modification of the partial graph procedure 
Construct a new revised cost matrix as follows. 


On the existing cost matrix: 

draw a horizontal line through each labelled supply vertex; 

draw a vertical line through each labelled demand vertex. 

* find the smallest entry 6 with only a horizontal line through it; 

© decrease all entries with only a horizontal line through them ] 5: 


increase the weight on the corresponding supply vertices by 
* increase all entries with only a vertical line ep them by 6; 
decrease the weight on the corresponding demand vertices by 6. 
Construct a revised partial graph. 
(Remove any edge that now has a non-zero cost.) 


Return to Part A. 


4 FLOW CHART FOR THE ALGORITHM 


awe 


Part A, Step 1 
Label supply vertices 
whose supplies are 
unallocated 


A, 


Part A, 


Label Supply ay 


demani 


ity 


¥ labelling possible 


vertices 


breakthrough 
not achieved 


problem in unit 


An algorithm for the knapsack problem 


1 WORKED PROBLEM 
Consider five items with the following weights and values. 


USE 


© branching tree 
* lower bounds 


2 SOLUTION VECTORS 
A solution vector is a sequence of the form (Xp Xo» Xxy Xs Xs)» 


x =1D if item lis packed; 
WH) x, =O ifitem/is not packed. 


A feasible solution is one which satisfies the weight constraint. 


(1, 1, ©, O, 1) corresponds to items A, B and E packed, feasible 
with total weightw=44+2+1=7(<$9) ¥ solution 


(0, 1,1, 0,1) corresponds to items B, C and E packed, infeasible 
with total weight w=2+7+1=10(>9) X solution 


3p BRANCHING IDEA 
For example: 


(0,1, 1,0, 0) these have one 
. more item than 
(0, 1,0, 0, oe 1,0, 1,0) there 


(0,1,0,0, 1) solution vector 


add altothe ) 
right of this 1 
—“~ 


4 DECIDING HOW TO BRANCH 


For example: 
(1,1,0,0,0) w Se 
(1,0,1,0,0) w= x é infeasible ) 


(1, 0, 0, O, O) 
(1, 0, 0, 1, 0) 


(1,0,0,0,1) w 


| branching 
| possible 


a 


Next step: branch out from (1, 1, 0, O, 0). 


5 OUTLINE OF ALGORITHM 


START with zero vector (0, 0, ..., 0); feasible with value 0. 
STORE (0, 0, ..., 0) and value 0. 


* Branch from first solution from which branching is possible. 
* Calculate total weight of each new solution. 


* Calculate total value of each new feasible solution. 
If there is a new feasible solution with value greater than the 
value stored, store the new solution vector and its value 
instead. 
Mark vertex with (1 if it corresponds to: 
© a vector which equals or exceeds weight restriction; 


© a vector which ends in 1. 
the GENERAL STEP until no more branching is possible. 


Stored solution vector and value is optimum solution. 
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6 SOLUTION TO WORKED PROBLEM 


totalweightw 
hot more than 9 


AS 


First branching: from zero solution vector O = (O, O, O, O, 0) withv = O: 


(1,0, 0,0, 0) 
(0,1,0,0,0) 
(0,0, 1,0, 0) 
(0, 0, 0, 1,0) 
(0, 0, 0, 0,1) 
STORE (0, 0,1, 0,0), v=9 


Second branching: from (1, O, O, O, O): 


(1,10, 0,0) 
(1, 0,1, 0,0) 
(1,0, 0, 1,0) 
(1.0, 0, 0,1) 


(1,0, 0, O, 0) 
(0, 1, 0, 0, O) 
(0, 0,1, 0,0) 
(0, 0, 0,1, 0) 

STORE (1, 1,0, 0,0), v=11 


Third branching: from (1, 1, O, O, O): 


(44,00) w=13 xX 
(1, 0, 0, 0,0.) ——e(1,1,0, 0,0) (440,40) wet X 
(0, 1,0, 0, 0) (410,01) w=7 v=(12) 
(0,0,1,0,0) 


(0, 0, O, 1, 0) 
STORE (1, 1,0, O, 1), v=12 


6 SOLUTION CONTINUED 


Fourth branching: from (0, 1, 0, O, O): 
(0,1,1,0,0) w=9 v=(17) 
(0,1, 0, 0, O) (0,1,0,1.0) w=7 v=l4 
(0, 0,1, 0, 0) (0,1,0,0,1) w=3 v=9 


(0, 0, 0, 1, O) 
STORE (0, 1,1, 0,0), v= 17 


Fifth branching: from (0, 1, O, 1, 0): 


(0,1,.0,0,0) ——e (0,1,0,1,0) ——f9](0,1.0,11) w=8 v=15 
ont (0,0,1,0, 0) bo 


v=6@*(0, 0, 0, 1,0) STORE unchanged 


Sixth branching: from (O, O, 1, O, O): 
(0,0,1,1,0) w=12 XX 
(0,0,1,0,1) w=@ v=10 
af 
(< STORE unchanged } 
: 


(0, 0,1,0,0) 
726? (0.0,0,1,0) 


— 
tn 


Seventh branching: from (O, O, O, 1, 0): 


Oe—(0, 0, 0, 1,0) ——{9](0,0,0,1,1) w=6 v=7 


pe 


No further branching is possible: STOP. 


Solution vector is (0, 1, 1, O, O): items B and ©, with value 17. 


An algorithm for the travelling salesman problem 


1 WORKED PROBLEM 


Find a S-cycle throughA, B, C, D, E with minimum total length: 


lower bound is 1+2+1+1+1=6 


pl Us ~ 
( © lower bounds 
SO branching tree 
ALA 


a ae Be 
a one entry from each row 


© one entry from each column 
Shas ee ee a ae | 


2 No 2-, 3- or 4-cycles a 


) 


2 Se er eae 


new lower bound is 6 +1 =7 


3 DECIDING HOW TO BRANCH 


Consider edges with zero weight: Rhodes ) 


exclude AC? 


lower bound increases by 1 +O =1 


Label each zero with possible increase In lower bound. 
Select an edge whose exclusion gives maximum increase in lower bound. 


—_" >, 
maximum increase In 
lower bound arises 


from excluding AC 
AA 


TRACK 1¢ 
4 CARRYING OUT BRANCHING 


reowonn. 
é select AC 


_——, 


lower bound 7 ee 


include AC exclude AC ‘cross out AC 
(80 exclude CA) 


5 OUTLINE OF ALGORITHM 
with a given x1 table of distances, corresponding to a 
complete weighted graph with » vertices. 


Carry out the initial row and column reduction, and calculate 
the initial lower bound. 


* Consider all the 8 with zero weight, and choose an 


allowable edge e whose exclusion leads to the greatest 
increase in lower bound; if there are several such edges, 
choose the first. 

Consider the consequences of including e¢ and excluding e. 
Use row and column reduction to determine these 
consequences, in terms of increases in the lower bound. 
Choose the option which gives the smaller lower bound; if 
the lower bounds are equal, include the edge e. 

STORE the current list of included edges, and the current 
lower bound. 

Continue from the current position uless the chosen option 
has a lower bound greater than a previously eliminated 
option, in which case backtrack to the earlier position. 


the GENERAL STEP until a cycle with n edges has been created. 
Stored list of edges is optimum solution. 
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6 SOLUTION TO WORKED PROBLEM: FIRST BRANCHING 
Consider edges with zero weight: 


include AC exclude AC 


reduce column E by 1 reduce column C by 2 


000 oO O 
0 


Me! 
cD 
x oO 
00 

4 


4 


TRACK 13 


7 SECOND BRANCHING 
Consider edges with zero weight: 


select BC 


(lower bound increases by 2, 
the maximum possible) 


Y 4 > 


include BC exclude BC 
(50 exclude CB) 


lower bound remains 9 


reduce column C by 2 
ea 


0 
D 
oO 
0 
4 


——_——~ 
J. hence * 
» includeBC ) 


a 


TRACK 14. 


& THIRD BRANCHING 
Consider edges with zero weight: 


select AD 


(lower bound increases by 4, 
the maximum possible) 


& 


include AD exclude AD 
(s0 exclude DA) 


TRACK 15 


9 FOURTH BRANCHING 
Consider edges with zero weight: 


4 


include BD 
(50 exclude DB) 


reduce column E by 2 
C02 


select BD 


(lower bound increases by 2, 
the maximum possible) 


~ 


exclude BD 


“TRACK 16 


10 FIFTH BRANCHING 
Consider edges with zero welght: 


include CA 


select CA 


(lower bound increases by 2, 


the maximum possible) 


? hence as 
) include CA ) 
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11 SIXTH BRANCHING 
Consider edges with zero weight: 


select AE 


(lower bound increases by 1, 
the maximum possible) 


4 & 


include AE exclude AE 
(50 exclude EC to 
avoid 3-cycleAECA) 


lower bound remains 12 


reduce column E by | 
(e) (o) 
B 
6 


1 
‘3 
x 
{o} 
3 


include BD 
2 


D 


TRAP Kk 


iy 


) 


12 FINAL BRANCHINGS 
Consider edges with zero weight: 


select BD 


(lower bound increases by 3, 
the maximum possible) 


4 


include BD 
‘60 exclude DB) 


4/6 C 
DIX O 
E|O X 


lower bound remains 12 


Include DC and EB hot possible! 
lower bound remains 12 (no route out of B) 


required S-cycle has edges 
CA, AE, EB, BD, DC 
and weight 12 


include BD 
12 


i ~ get same cycle ) 
\ (in opposite direction) ¢ 
fromhere 


pm, 


(1) include BD 
12 
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Printed in the United Kingdom. 


